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DETAILED ACTION 



1 . This action is responsive to the original application filed on October 7, 2003. 

2. Claims 1-27 are currently pending in this application. Claims 1,10 and 18 are 
independent. 

Priority 

3. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Information Disclosure Statement 

4. The information disclosure statement (IDS) submitted on October 7, 2003. The 
submission is in compliance with the provisions of 37 CFR 1 .97. Accordingly, the 
information disclosure statement is being considered by the examiner. 

Drawings 



5. Figures 1A, 1B, 2, and 3A-3D should be designated by a legend such as -Prior 
Art- because only that which is old is illustrated. See MPEP § 608.02(g). Corrected 
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drawings in compliance with 37 CFR 1 .121 (d) are required in reply to the Office action 
to avoid abandonment of the application. The replacement sheet(s) should be labeled 
"Replacement Sheet" in the page header (as per 37 CFR 1 .84(c)) so as not to obstruct 
any portion of the drawing figures. If the changes are not accepted by the examiner, the 
applicant will be notified and informed of any required corrective action in the next Office 
action. The objection to the drawings will not be held in abeyance. 

Specification 

6. The abstract of the disclosure is objected to because line 1 1 reads "unit perform 
an edge detecting" and should be changed to "unit performing an edge detecting. Line 
18 reads "according to the edge detection unit of the edge detection unit". Correction is 
required. See MPEP § 608.01(b). 

7. The disclosure is objected to because of the following informalities: On page 4 
line 24 there is a closed parenthesis that should be deleted after the word 
"components". On page 8 line 8 the disclosure reads "simultaneously perform the edge" 
and should be changed to "simultaneously performing the edge". On page 1 1 , line 7 the 
disclosure reads "edges shows" and should be changed to "edges show". On page 12 
line 8 the disclosure reads "according to an aspect to another aspect" and the first 
"according to an aspect" should be deleted. On page 13 line 16 formula 2 is written 
incorrectly according to the description above it in the disclosure, it should read 
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(X) = 4G3 - (G1 +G2+G4+G5). On page 1 7 lines 29 and 36 a 3x4 window is 
referenced, but should be changed to a 3x3 window as previously described in the 
disclosure. On page 17 line 33 the disclosure reads "since all most pixel" and should be 
changed to read since most pixel". Page 20 lines 24-32 need to be reformatted to be 
clearer. 

Appropriate correction is required. 

Claim Objections 

8. Claims 1 and 20 are objected to because of the following informalities: lack of 
clarity and precision. 

Claim 1 reads "a line buffer receiving the image data to output the image data", 
but would be clearer if it read "a line buffer receiving the image data to output the 
received image data". Claim 1 states at the end that the enhancing is done "according 
to the edge detection unit of the edge detection unit" and should be changed to read 
"according to the edge detection value of the edge detection unit". 

Claim 20 reads "the interpolation unit performs the interpolation unit", the second 
unit should be removed. 

Appropriate correction is required. 
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Claim Rejections - 35 USC §112 

9. The following is a quotation of the second paragraph of 35 U.S.C. 1 1 2: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

10. Claim 2 rejected under 35 U.S.C. 112, second paragraph, as being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

1 1 . Claim 2 recites the limitation "the selection signal" at the end of claim 2, but 
references a selection signal in claim 1 and the beginning of claim 2. There is 
insufficient antecedent basis for this limitation in the claim. 

Claim Rejections - 35 USC § 102 

12. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21 (2) 
of such treaty in the English language. 

13. Claims 1-3, 5, 6, 8-18, 19, 20, 25-27 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Lin (US 6,628,330). 
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Consider claim 1 , Lin explicitly teaches "an apparatus for performing edge 
enhancement (horizontal/vertical edge enhancer), comprising: 

an image sensor (CCD/CMOS sensor 12, fig 1) sensing an image to output 
image data (outputs image data to the digital color interpolate and enhance unit 10, 
which is shown in fig 4); 

a line buffer (two-line buffer 30, fig 4) receiving the image data (line buffer is fed a 
stream of mono-color pixels from the sensor, column 7, lines 64-65) to output the 
[received] image data (a region of 3x3 pixels is sent from the line buffer 30 to 
interpolator 42, column 8, lines 22-23); 

a register (interpolator 42, fig 4) storing the image data transmitted from the line 
buffer (must store the data at least temporarily in order to operate on the information); 

an interpolation unit (green color interpolate and edge detect 44, red color 
interpolate 46, and blue color interpolate 48 fig 4) performing an interpolation operation 
on the image data received from the register (column 8, lines 62-67 through column 9, 
lines 1-58 describe the interpolation performed by each unit); 

an edge detection unit (green color interpolate and edge detect 44, see also fig 
6) performing an edge detection operation on the image data received from the register 
(column 9, lines 42-53) to output an edge detection value (EDGE value described in 
column 9, lines 54-58) in parallel to the interpolation operation of the interpolation unit 
(Fig 6 illustrates the green color interpolation in parallel operation with the edge 
detector, column 9, lines 27-28) according to a selection signal representing a pattern of 
the image data stored in the register (column 10, lines 36-67 and column 11, lines 1-67 
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describe the determination of the patterns of image data stored in the interpolator 42) ; 
and 

an edge enhancement unit (edge enhance 52, fig 4) enhancing an output of the 
interpolation unit (see fig 4 outputs G, R, and B) according to the edge detection [value] 
(see fig 4 output EDGE) of the edge detection unit (green color interpolate and edge 
detect 44, see also fig 10 and column 12, lines 9-13)." 

Consider claim 2, Lin explicitly teaches "the apparatus of claim 1 , wherein the 
interpolation unit outputs a selection signal (interpolation unit outputs G signal which 
varies according to odd or even lines which is interpreted as a selection signal, column 
10 lines 36-67 through column 11, lines 1-23), and the edge detection unit detects the 
edge detection value (EDGE value is always detected by interpolator and edge detector 
44) when the selection signal is in an enabled state (signal is always enabled)." 

Consider claim 3, Lin explicitly teaches "the apparatus of claim 1, further 
comprising: 

a comparison unit (COMP 74 and 76, fig 10) comparing the edge detection value 
(EDGE) with a reference value (G_THRES and R/B_THRES), wherein the edge 
enhancement unit enhances the output of the interpolation unit when the edge detection 
value is greater than the reference value (column 12, lines 14-41 explain the way the 
edge enhancer enhances the output of the interpolator R, G, and B when EDGE 
exceeds the THRES value)." 

Consider claim 5, Lin explicitly teaches "the apparatus of claim 1 , wherein the 
line buffer (line buffer 30) outputs the image data sensed by the image sensor in a unit 
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of 3 lines (using temporary buffer 31 to store new pixels from line H3 allows for 3 lines 
of pixels to be sent to interpolator 42, column 8, lines 15-18)." 

Consider claim 6, Lin explicitly teaches "the apparatus of claim 1 , wherein the 
register (interpolator 42) stores the image data in a unit of a window in which 3x3 pixels 
are disposed (a region of 3x3 pixels is sent from the line buffer 30 to the interpolator 42, 
column 8, lines 9-27; this information bust be at least temporarily stored in the 
interpolator in order to be operated on)." 

Consider claim 8, Lin explicitly teaches "the apparatus of claim 3, further 
comprising: 

a comparison unit (COMP 74 and 76, fig 10) comparing the edge detection value 
(EDGE) with a reference value (G_THRES and R/BJTHRES) to output a weight 
(G_SCALE_F ACTOR and R/B_SCALE_FACTOR), wherein the weight is not zero when 
the edge detection value is greater than the reference value, and is zero when the edge 
detection value is not greater than the reference value (column 12, lines 16-27), and the 
edge detection value is modified to a multiplication value of the weight and the edge 
detection value (see fig 10 if the edge value is greater than the threshold, mux 70 or 72 
outputs the scale factor which the edge value is then multiplied by using multiplier 63 or 
66) is so that the output of the interpolation unit is enhanced according to the 
multiplication value (the value is enhanced if an edge is detected, column 12, lines 22- 
23)." 

Consider claim 9, Lin explicitly teaches "the apparatus of claim 3, wherein the 
interpolation unit outputs R, G, and B values (see fig 4 interpolation units 44, 46, and 48 
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output G, R, and B respectively), and the edge enhancement unit adds the multiplication 
value to the G value (see fig 10 the multiplication value from multiplier 63 is added to 
the G value using the adder 61 )." 

Consider claim 10, Lin explicitly teaches "a method of performing edge 
enhancement (horizontal/vertical edge enhancer), the method comprising: 

sensing (CCD/CMOS sensor 12, fig 1) an image to output image data (outputs 
image data to the digital color interpolate and enhance unit 10, which is shown in fig 4); 

receiving the image data to output the image data in a line buffer (line buffer is 
fed a stream of mono-color pixels from the sensor, column 7, lines 64-65); 

storing the image data in a register (interpolator 42 must store the data at least 
temporarily in order to operate on the information); 

performing an interpolation operation on the image data received from the 
register (column 8, lines 62-67 through column 9, lines 1-58 describe the interpolation 
performed by each unit); 

performing an edge detection operation on the image data received from the 
register (column 9, lines 42-53) to output an edge detection value (EDGE value 
described in column 9, lines 54-58) in parallel to the interpolation operation (Fig 6 
illustrates the green color interpolation in parallel operation with the edge detector, 
column 9, lines 27-28) according to a selection signal representing a pattern of the 
image data (column 10, lines 36-67 and column 1 1 , lines 1-67 describe the 
determination of the patterns of image data stored in the interpolator 42); and 
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enhancing an output of the interpolation operation (see fig 4 outputs G, R, and B) 
according to the edge detection value (see fig 4 output EDGE, see also fig 1 0 and 
column 12, lines 9-13)." 

Consider claim 11, Lin explicitly teaches "the method of claim 10, wherein the 
enhancing of the output of the interpolation operation comprises: 

Adding the edge detection value to the output of the interpolation operation (see 
fig 10, EDGE value is multiplied by the scale factor and then added to the output of the 
interpolation value at either adder 61, 68, or 69, see column 12, lines 14-41)." 

Consider claim 12, Lin explicitly teaches "the method of claim 1 1, wherein the 
enhancing of the output of the interpolation operation comprises: 

comparing the edge detection value with a reference value (see fig 10 COMP 
units 74 and 76 compare the EDGE value to a reference THRES, see column 12, lines 
14-41); 

outputting a multiplication value of the edge detection value and a weight 
generated when the edge detection value is greater than the reference value (see fig 10 
if the EDGE is greater than the THRES a SCALE_FACTOR is multiplied by the EDGE 
value at multiplier 63 or 66, see column 12, lines 14-41); 

outputting zero value when the edge detection value is not greater than the 
reference value (see fig 10 mux 70 or 72 outputs a zero if the EDGE value is not greater 
than the reference value THRES, see column 12, lines 14-41); and 

adding one of the multiplication value or the zero value to the output of the 
interpolation operation (see fig 10 and adder 61, 68, or 69, see column 12, lines 14-41)." 
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Consider claim 13, Lin explicitly teaches "the method of claim 10, wherein the 
enhancing of the output of the interpolation operation comprises: 
setting a reference value (see fig 10 THRES values); 

comparing the edge detection value with the reference value (see fig 10 COMP 
74 and 76 compare the EDGE value to the THRES value, see column 12, lines 14-41 ); 

outputting a multiplication value of the edge detection value and a weight 
generated when the edge detection value is greater than the reference value (see fig 
10, edge enhancer outputs a multiplication value of a SCALE_FACTOR and the EDGE 
value if the result of the COMP is that the EDGE value is greater than the THRES, see 
column 12, lines 14-41); 

outputting zero value when the edge detection value is not greater than the 
reference value (see mux 70 in fig 10; it outputs a 0 if the EDGE value is less than a 
THRES, see column 12, lines 14-41); and 

adding one of the multiplication value or the zero value to the output of the 
interpolation operation (see adder 61 , 68, or 69 in fig 10 which adds the multiplication 
value to either the R, G, or B output of the interpolator, see column 12, lines 14-41 )." 

Consider claim 14, Lin explicitly teaches "the method of claim 10, wherein the 
outputting of the image data in the line buffer comprises: 

outputting the image data in a unit of 3 lines (using temporary buffer 31 to store 
new pixels from line H3 allows for 3 lines of pixels to be sent to interpolator 42, column 
8, lines 15-18)." 
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Consider claim 15, Lin explicitly teaches "the method of claim 10, wherein the 
storing of the image data in the register comprises: 

storing the image data in a unit of a window in which 3x3 pixels are disposed (a 
region of 3x3 pixels is sent from the line buffer 30 to the interpolator 42, column 8, lines 
9-27; this information must be at least temporarily stored in the interpolator in order to 
be operated on)." 

Consider claim 16, Lin explicitly teaches "the method of claim 10, wherein the 
performing of the interpolation operation comprises: 

outputting a selection signal representing a pattern of the image data stored in 
the register (interpolation unit outputs G signal which varies according to odd or even 
lines which is interpreted as a selection signal, column 10 lines 36-67 through column 
11, lines 1-23)." 

Consider claim 17, Lin explicitly teaches "the method of claim 16, wherein the 
performing of the edge detection operation comprises: 

performing the edge detection operation when the selection signal is in an 
enabled state (EDGE value is always detected by interpolator and edge detector 44 due 
to the fact that the selection signal is in the enabled state)." 

Consider claim 18, Lin explicitly teaches "an apparatus for performing edge 
enhancement (horizontal/vertical edge enhancer), comprising: 

a memory unit (two-line buffer 30, fig 4) storing image data in a unit of a window 
having lines each having a predetermined number of pixels (a region of 3x3 pixels is 
sent from the line buffer 30 to interpolator 42, column 8, lines 22-23); 
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an interpolation unit (green color interpolate and edge detect 44, red color 
interpolate 46, and blue color interpolate 48 fig 4) performing an interpolation operation 
on the image data received from the memory unit (column 8, lines 62-67 through 
column 9, lines 1-58 describe the interpolation performed by each unit); 

an edge detection unit (green color interpolate and edge detect 44, see also fig 
6) performing an edge detection operation on the image data received from the 
memory unit (column 9, lines 42-53) to detect an edge detection signal (EDGE value 
described in column 9, lines 54-58) when the interpolation unit performs the 
interpolation (Fig 6 illustrates the green color interpolation in parallel operation with the 
edge detector, column 9, lines 27-28); and 

an edge enhancement unit (edge enhance 52, fig 4) enhancing an output of the 
interpolation unit (see fig 4 outputs G, R, and B) according to the edge detection signal 
(see fig 4 output EDGE) of the edge detection unit (green color interpolate and edge 
detect 44, see also fig 1 0 and column 12, lines 9-1 3)." 

Consider claim 19, Lin explicitly teaches "the apparatus of claim 18, further 
comprising: 

an image sensor (CCD/CMOS sensor 12, fig 1) sensing an image to output the 
image data (outputs image data to the digital color interpolate and enhance unit 10, 
which is shown in fig 4).". 

Consider claim 20, Lin explicitly teaches "the apparatus of claim 18, further 
comprising: 
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a control unit (line buffer 30) generating a pattern signal representing a pattern of 
the image data stored in the memory unit (column 10, lines 36-65) in a unit of the 
window (see fig 8A and 8B for patterns), wherein the interpolation unit performs the 
interpolation unit according to the pattern signal (according to line sent from the line 
buffer, odd/even, the interpolator interpolates the data according to the arrays in fig 8C 
and 8D)." 

Consider claim 25, Lin explicitly teaches "the apparatus of claim 18, wherein the 
edge detection unit and the interpolation unit simultaneously perform the edge detection 
operation and the interpolation operation, respectively (Fig 6 illustrates the green color 
interpolator in parallel operation with the edge detector column 9, lines 27-28)." 

Consider claim 26, Lin explicitly teaches "the apparatus of claim 18, wherein a 
time delay occurs with respect to the image data when the edge detection unit detects 
the edge detection signal, and the time delay is a period of time during which pixel 
values of the pixels disposed in the window are stored in the memory unit (column 8 
lines 1-27 describe the function of the line buffer 30 and show that at every clock cycle 
the 3x3 region of pixels is sent to the interpolator so each clock cycle is interpreted as 
the time delay)." 

Consider claim 27, Lin explicitly teaches "The apparatus of claim 18, wherein the 
interpolation unit and the edge detection unit are coupled between the memory unit and 
the edge enhancement unit in parallel (see fig 4 interpolation and edge detection unit 44 
is between the line buffer 30 and the edge enhancer 52 and Fig 6 illustrates the green 
color interpolator in parallel operation with the edge detector column 9, lines 27-28)." 
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Claim Rejections - 35 USC § 103 

14. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

15. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

16. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lin (US 
6,628,330) in view of Uchida et al. (US 2003/0118231). 

Consider claim 4, Lin explicitly teaches the apparatus of claim 3, and a control 
unit (line buffer 30) outputs a signal representing a pattern of the image data (column 
10, lines 36-65 and see fig 8A and 8B for patterns) stored in the register. 

However, Line does not explicitly teach that the control unit outputs the reference 
value to the comparison unit. 

In the same field of endeavor Uchida et al. teach an image processing apparatus 
which performs edge detection. Uchida et al. further teach the use of a CPU 102 in fig 
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6a, which sets the threshold value of the edge detector so that it removes signals equal 
to or smaller than the threshold (paragraph [0145]). 

Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to include the CPU used to send a threshold value to the 
edge detector found in Uchida et al. into the apparatus found in Lin in order to create a 
noise-free sharp edge on an image (paragraph [0009] in Uchida et al.). 
17. Claims 7, and 21-24 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lin (US 6,628,330) in view of Horie et al. (US 5,113,252). 

Consider claim 7, Lin explicitly teaches the apparatus of claim 1 , wherein the 
edge detection unit receives the image data to generate the edge detection value (see 
fig 10, unit 44 receives image data and then generates an EDGE value). 

However, Lin does not explicitly teach the use of the equation X = 4Gc - (G1 + 
G2 + G3 + G4), where X is the detection value, Gc is the center pixel value, and G1-G4 
are the adjacent pixel values. 

In the same field of endeavor Horie et al. teach an image processing apparatus 
that is capable of edge emphasis or smoothing processing. Horie et al. further teach 
that that edge emphasis is executed based on a matrix and a formula shown in FIG. 26 
(column 27, lines 14-16). Fig 26 shows a 3x3 matrix with an equation that reads 
A+(1/8){4A-(B+C+D+E)}, which shows the edge detection value which is found by 
multiplying the center pixel by 4 and subtracting the surrounding pixels. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to include the equation found in Horie et al. into the 
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apparatus found in Lin in order to avoid using complex transforms in edge emphasis, 
thus reducing the size of the processing circuit and also to reduce noise in processing 
(column 27, linesl 1-25). 

Consider claim 21 , Lin explicitly teaches the apparatus of claim 1 8. 

However, he does not explicitly teach that the edge detection signal is formed by 
a multiplication of the center pixel and an addition of the surrounding pixels. 

In the same field of endeavor Horie et al. teach an image processing apparatus 
that is capable of edge emphasis or smoothing processing. Horie et al. further teach 
that that edge emphasis is executed based on a matrix and a formula shown in FIG. 26 
(column 27, lines 14-16). Fig 26 shows a 3x3 matrix with an equation that reads 
A+(1/8){4A-(B+C+D+E)}, which shows the edge detection value which is found by 
multiplying the center pixel by 4 and subtracting the surrounding pixels. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to include the equation found in Horie et al. into the 
method found in Lin in order to avoid using complex transforms in edge emphasis, thus 
reducing the size of the processing circuit and also to reduce noise in processing 
(column 27, linesl 1-25). 

Consider claim 22, Lin further teaches "the apparatus of claim 21 , wherein the 
interpolation unit outputs R, G, and B components (see fig 4 interpolation units 44, 46, 
and 48 output G, R, and B respectively), and the edge enhancement unit adds a second 
sum of the multiplication and the sum to the a value of the G component to enhance the 
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G component (see fig 10 the multiplication value is added to the G value in order to 
enhance the G value, see also see column 12, lines 14-41)." 

Consider claim 23, Lin further teaches "the apparatus of claim 21 , wherein the 
interpolation unit outputs a selection signal when it is determined that the pixel value of 
the center pixel is the G component (interpolation unit outputs G signal which varies 
according to odd or even lines which is interpreted as a selection signal, column 10 
lines 36-67 through column 11, lines 1-23), and the edge detection unit outputs the 
edge detection signal according to the selection signal (EDGE value is detected by 
interpolator and edge detector 44 in accordance with the interpolation unit)." 

Consider claim 24, Lin further teaches "the apparatus of claim 21 , wherein the 
edge detection unit modifies the edge detection signal according to a reference value 
representing a level of the edge enhancement level to generate the modified edge 
detection signal, and the edge enhancement unit adds the modified edge detection 
signal to an output of the interpolation unit (see fig 10 edge enhancement unit modifies 
edge detection signal according to THRES hold comparison and then adds the modified 
signal to the output of the interpolator via adder 61, 68, or 69, see also column 12, lines 
14-41)." 

Conclusion 

18. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Kao et al. (US 6,774,943) teaches mixing pixel interpolation and 
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edge enhancement of a 3x3 pixel array and includes line buffers. Lin et al. (US 
6,642,962) teaches a camera processor with a 4 line buffer and edge enhancer. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Scott Egan whose telephone number is (571 ) 270-1452. 
The examiner can normally be reached on Monday-Friday 8:00 a.m. - 5:00 p.m., EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Patrick Edouard can be reached on (571) 270-1455. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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